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ABSTRACT 



The apparatus of the present invention preferably comprises 
an image sensor, an orientation sensor, a memory and a 
processing unit. The image sensor is used for generating 
captured image data. The orientation sensor is coupled to the 
image sensor, and is used for generating signals relating to 
. the position of the image sensor. The memory, has an 
auto-rotate unit comprising program instructions for trans- 
forming the captured image data into rotated image data in 
response to the orientation sensor signals. The processing 
unit, executes program instructions stored in the memory, 
and is coupled to the image sensor, the orientation sensor 
and the memory. The method of the present invention 
preferably comprises the steps of: generating image data 
representative of an object with an image sensor; identifying 
an orientation of the image sensor relative to the object 
during the generating step; and selectively, transferring the 
image data to an image processing unit in response to the 
identifying step. 

44 Claims, 17 Drawing Sheets 
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APPARATUS AND METHOD FOR ROTATING pixels is processed by an image processing algorithm. Image 

THE DISPLAY ORIENTATION OF A processing routines are conventionally designed to process 

CAPTURED IMAGE pixel signals line-by-line, conforming to a specific and 

unchanging pixel pattern format. Thus, image sensors manu- 

Matter enclosed in heavy brackets [ ] appears in the 5 factured with the Bayer pixel pattern format will be coupled 

original patent but forms no part of this reissue specifi- to image processing routines specifically designed to accept 

cation; matter printed in italics indicates the additions pixel signals in alternating sequences of "GRGRGR" and 

made by reissue. "BGBGBG " Due to possible imperfections in the outer 

rows and columns of pixels that make up the image sensor, 

This application relates to co-pending U.S. patent appli- 10 conventional digital cameras sometimes have image sensors 

cation Ser. No. 08/355,031 , entitled A System and Method large enough so that one or more lines of pixels at the sides 

For Generating a Contrast Overlay as a Focus Assist for An 0 f the image sensor can be ignored. 

Imaging Device, filed on Dec. 13, 1994, by inventor Eric C. Referring now to FIG. ID, a prior art graphical represen- 

Anderson; and U.S. patent application Ser. No. 08/384,012, tation is shown of the object as captured , in the portrait 

entitled Apparatus and Method for Camera Image and 15 orientation and output upon an image display 100. The 

Orientation Capture, filed on Feb. 6, 1995, by inventor Scott i mage display 100 is typically a conventional stand-alone, 

Fullam. The subject matter of the two applications described personal computer CRT having a top 102, a right side 104, 

above is hereby incorporated by reference. These related a j e ft s i<j e 105 m d a bottom 108. 

applications are commonly assigned to Apple Computer, As previously described, the image processing routines 

^ nc - 20 within digital cameras are conventionally designed to pro- 

BACKGROUND OF THE INVENTION cess pixel signals on a line-by-line basis according to only 

1 Field of the Invention one ^ xel P attem f ormat - Thus, conventional digital cameras 
^ ... „ process images as if they were always in a landscape format. 
The present .nvention relates generally to an apparatus In the presentation of the landscape image of FIG 1 A upon 
and method for orienting an image. More parttcularly, the 25 ^ J djspl ^ . w> ^ ^ ^ 
present invention » an apparatus and method for rotaung a ]m ^ co ond t0 me F t 102 of the 
captured image to an orientation corresponding to an .mag- fig. id image display 100. Such an orientation for land- 
ing subsystem s orientation at the time in which the image ^ images * on disp , ay m h ^ natura) ^ 

wa f c j*P ur f '. is acceptable for ease of viewing the image. However, the 

2. Description of the Background Art 30 pre sentation of the portrait image of FIG. IB upon the image 

When a digital camera captures an image of an object, the display results in the "TOP" of the portrait image corre- 

camera's frame of reference with respect to the object sponding to either the right side 104 or the left side 106 of 

produces a desired image orientation. Two conventional tne image display 100, depending on how the user had 

image orientations exist, namely, a landscape orientation and rotated the digital camera. FIG. ID explicitly shows the case 

a portrait orientation. Referring now to FIG. 1A, a prior art 35 wne re the 'TOP" of the portrait image corresponds to the 

graphical representation of an object in a landscape orien- rignt side 0 f tne image display 100. This "sideways" 

tation is shown, in which the image's width is greater than orientation for portrait images on the image display 100 is 

its height. Referring also now to FIG. IB, a prior art unacceptable and unnatural. This undesirable by-product of 

graphical representation of the object in a portrait orientation conventional digital cameras requires that the user rotate 

is shown, in which the image's height is greater than its 40 portrait images so that they are presented in a more natural 

width- and upright viewing angle on the image display 100. It 

In a digital camera, an image sensor is comprised of should be noted that this problem also exists for digitized 

light-sensitive devices, such as charge-coupled devices images from conventional film cameras. Traditional rotation 

(CCD), that convert an optical image into a set of electrical methods also have the disadvantage of requiring two blocks 

signals. Referring now to FIG. 1C, a prior art image sensor 45 of memory to rotate a stored image, 

is shown having a 480 row by 640 column matrix of light what is needed is an apparatus and method that efficiently 

collecting pixels. The image sensor is orientated within a and automatically rotates a stored photographic image to 

body of the digital camera so that a first row of pixels (i.e. correspond to the orientation in which the photographic 

row r,) corresponds to the bottom of an upright and level image was captured, 

digital camera. This image sensor orientation is required 50 

since as an optical image passes through a conventional SUMMARY OF THE INVENTION 

camera lens it is inverted. The image sensor in a color digital The present invention is an apparatus and method for 

camera typically consists of an array of green (G), red (R) rotating the display orientation of a captured image. The 

and blue (B) pixels. Alternative embodiments include sen- . apparatus of the present invention preferably comprises an 

sors detecting cyan, magenta, yellow and green as is typi- 55 image sensor, an orientation sensor, a memory and a pro- 

cally used in video cameras. Other image sensor configu- cessing unit. The image sensor is used for capturing image 
rations are also used. The pixels that comprise the image , data. The orientation sensor is coupled to the image sensor, 

sensor are arranged into various patterns or formats. A and is used for generating a portrait signal if the image 

common image sensor format is called a Bayer pattern. The sensor is positioned in a portrait orientation relative to the 

Bayer pattern format is defined as a pixel pattern comprised 60 object. The memory, has an auto-rotate unit comprising 

of 50% green-light responsive pixels, 25% red-light respon- program instructions for transforming the captured image 

sive pixels and 25% blue-light responsive-pixels arranged in data into rotated image data in response to the portrait signal, 

alternating rows of "GRGRGR" and "BGBGBG," as shown The processing unit, is used for executing program instruc- 

in FIG. 1C. Throughout this specification, "G" means tions stored in the memory, and is coupled to the image 

"green," "R" means "red," and "B" means "blue." 65 sensor, the orientation sensor and the memory. 

Once an image is captured by the digital camera, a set of The method of the present invention preferably comprises 

pixel signals corresponding to the image received by the the steps of: generating image data representative of an 



US RE38.896 E 

3 4 

object with an image sensor; identifying an orientation of the processing and storage subsystem 208, which stores the data 

image sensor relative to the object during the generating in internal memory. The bus 206 also passes various status 

step; and selectively transferring the image data to an image and control signals between the imaging subsystem 204 and 

processing unit in response to the identifying step. the processing and storage subsystem 208, as will be further 

5 discussed below. 

BRIEF DESCRIPTION OF THE DRAWINGS Referring now to FIG. 3A, a block diagram is shown 

tA . - c illustrating the imaging subsystem 204 of the present inven- 

FIG. 1A is a prior art graphical representation of an tion< The imaging subsystem 2 04 preferably comprises a 

object in a landscape orientation; lens 300 having an iris, an optical filter 302, an image sensor 

FIG. IB, is a prior art graphical representation of the I0 304, a timing generator 306, an analog signal processor 

object in a portrait orientation; (ASP) 308, an analog-to-digital (A/D) converter 310, a 

FIG, 1C, is a prior art 480 row by 640 column image digital signal processor (DSP) 320, a right/left orientation 

sensor; sensor (RLOS) 324, an up/down orientation sensor (UDOS) 

FIG. ID, is a prior art graphical representation of the 326 and one or more motors 312. U.S. patent application Ser. 

object as captured in the portrait orientation and output upon 15 No - 08/355,03 1 , entitled A System and Method For Gener- 

an image display; atm 2 a Contrast Overlay as a Focus Assist For An Imaging 

nir- i .v.uui,^ ~ r r a u j- . c Device, filed on Dec. 13, 1994 is incorporated herein by 

FIG. 2, is a block diagram of a preferred embodiment of f . . , . \ ., . • « ■ - * 

o« a nn oro..,c ^ *• ,u a' i ■ ► p reference and provides a detailed di scussion of the preferred 

an apparatus for rotating the display orientation of a cap- A i™_ fr „ : „ ,u ■ u • u ^ 

turedimw "J v elements in the imaging subsystem 204, with the exception 

iurea image, 20 of the RLOS 324 and the UDOS 326. U.S. patent application 

FIG. 3A, is a block diagram of a preferred embodiment of Ser Na 08/384,012, entitled Apparatus and Method for 

an imaging subsystem of the present invention; Camera image and orientation Capture, filed on Feb. 6, 

FIG. 3B, is a first graphical representation of a preferred 1995 is incorporated herein by reference and provides a 

embodiment of an image sensor disposed within the present detailed discussion of various embodiments of the RLOS 

invention; 25 324 and the UDOS 326, which are further discussed below. 

FIG. 3C is a second graphical representation of a pre- Briefly, the imaging subsystem 204 captures an image of the 

ferred embodiment of the image sensor within the present object 202 via light impacting the image sensor 304 along an 

invention; optical path 314. The image sensor 304 in turn generates a 

FIG. 4A, is a block diagram of a preferred embodiment of set of P ixeI si S naIs representative of the captured image data, 

a processing and storage subsystem of the present invention; 30 After beim J processed by the ASP 308, the A/D converter 

v\r ad o wi^v ai^^ a u a- . r 310 and the DSP 320; the captured image data passes over 

FIG 4B, is a block diagram of a preferred embodiment of (he bu$ 206 tQ me S J and stora 6 subs H ystem 208 . 

a volatile memory witmn me processing and storage sub- ^ functions perfo ^ med by tbe DSP 32 q 

may alternatively 

' _ . . be performed in the processing and storage subsystem 208. 

FIG. 4C, is a block diagram of a preferred embodiment of Referri now l0 FIG 3B a hjcal representalion is 

a frame buffer data structure within a frame buffer; snown illustrating the image sensor fa disp0 F sed witnin the 

FIG. 4D, is a block diagram of the preferred embodiment camera 200. FIG. 3B shows the camera 200 maintained in a 

of a non-volatile memory within the processing and storage landscape orientation while directly facing the object 202. 

subsystem; The image sensor 304 has a front 338 and a top 336, which 

FIG. 5A, is a graphical representation of a preferred 40 are juxtaposed with a front 334 and a bottom 332 of the 

embodiment of portrait_Jeft image data within the frame camera 200 respectively. The front side 338 of the image 

buffer data structure; sensor 304 comprises light-sensitive pixels, which capture 

FIG. 5B, is a graphical representation of a preferred an image received along the optical path 314 and through the 

embodiment of portrait_right image data within the frame lens 300 mounted upon the camera 200. It should be noted 

buffer data structure; 45 tnat me image recorded by the image sensor 304 is inverted 

FIG. 5C, is a graphical representation of a preferred re,ative t0 the °^ ct b * the J en f s 300 The front 338 of the 

embodiment of landscape image data within the frame buffer image sensor 304 P referabl y forms a P ,anar ™ 

data structure* and " shown in perspective in FIG. 3B. When the image sensor 

□pc , A *n a*w* a 1 1 ■ r e t • 304 is oriented as shown in FIG. 3B, a landscape image of 

FIGS 6A, 6B, 6C and 6D are a flowchart of a preferred tne o5ject 202 ig ca tured When the camera 20 F 0 h 

method for rotating the display onentation of a captured either 9Q o dockwise or 90 o counterclockvvise about the 

image * x-axis, a portrait image of the object 202 is captured. 

DETAILED DESCRIPTION OF THE Referring now to FIG. 3C, a graphical representation is 

PREFERRED EMBODIMENTS shown illustrating the image sensor 304, which has the top 

55 336, a right side 342, a left side 340 and a bottom 344. The 

The present invention is an apparatus and method for image sensor 304 is comprised of a plurality of pixels 

rotating the display orientation of a captured image. arranged in an i-row by j-column array. In the preferred 

Referring now to FIG. 2, a block diagram is shown embodiment, the pixels are arranged in a Bayer pattern 
illustrating a camera 200 for rotating a display orientation of format. Alternatively the present invention may be applied 
a captured image. In the preferred embodiment, the camera 60 to image sensors of various sizes and image processing 
200 is a digital camera, such as a QuickTake 150, by Apple routines designed to process pixel signals arranged in pat- 
Computer of Cupertino, Calif. The camera 200 preferably terns or formats different from the Bayer pattern, 
comprises an imaging subsystem 204, a bus 206 and a As stated above, the RLOS 324 (i.e. the right/left orien- 
processing and storage subsystem 208. Reflected light from tation sensor) and the UDOS 326 (i.e. the up/down orien- 
an object 202 is conventionally captured by the imaging 65 tation sensor) are disposed within the imaging subsystem 
subsystem 204 via a button press or some other action. The 204. Both the RLOS 324 and the UDOS 326 are physically 
captured image data is transferred over the bus 206 to the coupled to the image sensor 304 and electrically coupled to 
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the DSP 320. The RLOS 324 monitors whether the camera an internal bus 402. In the preferred embodiment, the 

200 is in a landscape orientation or a portrait orientation. If processing and storage subsystem 208 is conventionally 

the camera 200 is in a portrait orientation, the RLOS 324 embedded as part of the camera 200. Alternatively, the 

identifies whether the camera 200 has been rotated clock- processing and storage subsystem 208 may be a desktop 

wise or counterclockwise, as viewed from the rear of the 5 type computer. 

camera 200. In response to such camera 200 rotation, the The buffer 400 is preferably a first-in, first-out buffer for 
RLOS 324 generates and transmits either a landscape signal, temporarily holding the captured image data and the imag- 
a portrait_left signal or a portrait_right signal to the DSP ing subsystem 204 control signals passed between the DSP 
320. More specifically, if the camera 200 is held in the 320 and the processing and storage subsystem 208. The 
landscape orientation shown in FIGS. 1 A and 3B, the RLOS 10 buffer 400 has data lines that are coupled to both the bus 206 
324 generates the landscape signal, since the top 336 of the and the internal bus 402. The processing unit 404 executes 
image sensor 304 corresponds to the "TOP" of the object programming instructions stored in the non- volatile memory 
202. However, if the camera 200 is rotated 90° clockwise 406 and the volatile memory 410 to perform various opera- 
about the x-axis, as viewed from the rear of the camera 200 tions. The non-volatile memory 406 stores a set of computer 
shown in FIG. 3B, the RLOS 324 generates the portrait_ 15 readable program instructions for controlling how the pro- 
right signal, since now the right side 342 of the image sensor cessing unit 404 accesses, transforms and outputs the image 
304 corresponds to the 'TOP'* of the object 202. And, if the data, as described in detail below with reference to FIG. 4D. 
camera 200 is rotated 90° counter-clockwise about the While the non-volatile memory 406 is preferably a Read 
x-axis, as viewed from the rear of the camera 200, the RLOS Only Memory (ROM), alternatively, the non-volatile 
324 generates the portrait__left signal, since now the left side 2 o memory 406 could be replaced with a functionally equiva- 
340 of the image sensor 304 corresponds to the "TOP" of the lent computer useable medium such as: a compact disk and 
object 202. drive; a floppy disk and drive; or a memory card. Additional 

The UDOS 326 monitors whether the camera 200 is in details on the function and operation of both the non-volatile 

either a level orientation or an off-level orientation. In memory 406 and the volatile memory 410 are provided 

response to a movement of the camera 200, the UDOS 324 2 5 below with reference to FIGS. 4B and 4D. 

generates and transmits either a level signal or an off-level The input device 408 is preferably a series of control 

signal to the DSP 320. Specifically, if the camera 200 is held buttons, responsive to user inputs, which generates signals 

in the landscape orientation shown in FIG. 3B, the UDOS that are translated by the processing unit 404 into control 

324 generates the level signal, since the front 334 of the signals to adjust the focus and other operating parameters of 

camera 200 directly faces the object 202. If the camera 200 30 the imaging subsystem 204. As mentioned above, while the 

is rotated more than 45° clockwise or counter-clockwise preferred embodiment of the camera 200 incorporates the 

about the y-axis, shown in FIG. 3B, the UDOS 324 prefer- RLOS 324 and UDOS 326, an alternative embodiment of the 

ably generates the off-level signal, since the front 334 of the present invention prompts the user to manually input, via the 

camera 200 now points either above or below the x-y plane. input device 408, the imaging subsystem's 204 orientation at 

Alternative embodiments of the present invention can 35 the time the captured image data was generated. Other 

change the specific measure of rotation necessary to gener- alternative embodiments incorporating the automatic RLOS 

ate the off-level signal from 45° to any number from 0° to 324 and UDOS 326 sensors could provide for an override 

180°. function that instructs the processing and storage subsystem 

Both the RLOS 324 and UDOS 326 sensors are preferably 208 to ignore the orientation signals generated by the RLOS 

identical in their structure and function. Their placement 40 324 and UDOS 326 sensors, enabling the user to retain full 

relative to the image sensor 304 determines whether the manual control over the final orientation of the captured 

signal generated by the orientation sensor is one of the image data on the image display 100. The I/O Interface 414 

RLOS 324 signals or the UDOS 326 signals. The DSP 320 .. is coupled to the internal bus 402 and has an external port 

receives both the RLOS 324 and the UDOS 326 signals and connector for coupling the processing and storage subsystem 

transmits them to the processing and storage subsystem 208 45 208 witn a nost computer (not shown) for downloading 

over the bus 206. While the preferred embodiment of the image data stored in the volatile memory 410 and thus 

present invention incorporates the orientation sensors 324, freeing up room in the volatile memory 410 for additional 

326, those skilled in the art will recognize that the orienta- sets of processed image data. In the second and alternative 

tion sensors 324, 326 are not required to practice the present embodiment discussed above where the processing and 

invention, if the processing and storage subsystem 208 50 storage subsystem 208 is a desktop type computer, the input 

prompts the photographer for the camera's 200 orientation at device 408 will also include a keyboard and mouse type 

the time an image is captured! Alternatively, an embodiment controller. 

using only the RLOS 324 enables practicing of the present Referring now to FIG. 4B, a block diagram is shown 

invention, but this alternative embodiment results in loss of illustrating a volatile memory 410 within the processing and 

the off-level signal. However, such an embodiment using 55 storage subsystem 208. The volatile memory 410 contains a 

only the RLOS 324 is still useful for most applications frame buffer 41 6, working memory 418 and storage memory 

requiring only landscape and portrait orientation using an 420 coupled to the internal bus 402. The volatile memory 

approximately level camera 200. A further alternative 410 is preferably a Random Access Memory (RAM), 

embodiment includes an RLOS 324 which only generates The frame buffer 416 is preferably comprised of a dedi- 

the landscape, portrait_left, or portrait_right signals if the 60 cated space of contiguous memory comprising an i-row by 

camera 200 is within a predetermined level range. j-column area for storing image data. There is preferably a 

Referring now to FIG. 4 A, a block diagram is shown constant one-to-one correspondence between the pixels 

illustrating the processing and storage subsystem 208 of the comprising the image sensor 304 array and the storage 

present invention. The processing and storage subsystem locations within the frame buffer 416 area. Alternatively, the 

208 comprises a buffer 400, a processing unit 404, a non- 65 pixel signals from the image sensor 304 array could be 

volatile memory 406, an input device 408, a volatile stored within the frame buffer 416 in a non-contiguous (i.e. 

memory 410 and an I/O interface 414, coupled together via sectored) memory format, as is commonly known in the art. 
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In the preferred embodiment, i and j are set equivalent to the 
size of the image sensor 304. Since the preferred image 
sensor 304 is a 481 by 641 array, i is set to 481 and j is set 
to 641. In alternative embodiments where the image sensor 
304 is only a 480 by 640 array, the frame buffer 416 will still 5 
preferably be a 481 by 641 array since, as is discussed 
below, an extra row and column is generated by the pro- 
cessing and storage subsystem 208. 

The working memory 418 preferably provides a tempo- 
rary space for storing data received from the input device 10 
408 and for data generated by the processing unit 404. The 
working memory 418 also contains additional memory for 
storing the RLOS 324 and UDOS 326 signals at the time the 
image data was captured by the image sensor 304; and 
additional information conventionally associated with the 15 
capture process, such as exposure and focus settings, time 
and date, statistical data, and the presence of any defective 
pixels, rows or columns within the image sensor 304. 

The storage memory 420 preferably provides space for 
storing multiple sets of image data, until the images are 20 
off-loaded from the camera 200 via the I/O interface 414. 
The storage memory 420 sets a maximum image data 
holding capacity of the camera 200. Alternatively, additional 
memory cards could also be coupled to the internal bus 402, 
providing even more image data storage capability. Such an 25 
additional memory card could be a non-volatile flash 
memory card. 

Referring now to FIG. 4C, a block diagram is shown 
illustrating a memory map of a volatile memory data struc- 3Q 
ture 417 within the volatile memory 410. The volatile 
memory data structure 417 comprises an image data field 
419 for storing the captured image data, an RLOS signal 
data field 421 for storing the RLOS 324 signal, an UDOS 
signal data field 423 for storing the UDOS 326 signal and a 35 
miscellaneous data field 425 for storing the exposure and 
focus settings, time and date, statistical data, and the pres- 
ence of any defective image sensor 304 pixels, rows or 
columns. The interactions of each of all these data fields 419, 
421, 423, 425 with the camera 200 is described in detail 40 
below. 

Referring now to FIG. 4D, a block diagram is shown 
illustrating the non-volatile memory 406 within the process- , 
ing and storage subsystem 208. The non-volatile memory 
406 comprises an auto-rotate unit 422, an image processing 45 
unit 424, an image capture unit 428 and an operating system 
unit 426. 

The image capture unit 428 controls the imaging sub- 
system's 204 focus and aperture settings; captures the image 
data; routes the image data into the frame buffer 416; routes 50 
the exposure and focus settings, time and date, statistical 
data, and the presence of any defective image sensor 304 
pixels, rows or columns into the miscellaneous data field 
425; generates additional rows and columns of image data 
within the frame buffer 416 if required; monitors the RLOS 55 
324 and UDOS 326; and sets the RLOS signal 421 data field 
and the UDOS signal 423 data field based on the RLOS 324 
and UDOS 326 outputs. In the preferred embodiment the 
image capture unit 428 corrects any pixel defects within the 
image sensor 304 using the information stored in the mis- 60 
cellaneous data field 425 before passing the image data to 
the auto-rotate unit 422. In an alternative embodiment, 
image processing unit 424 corrects any pixel defects within 
the image sensor 304 using the information stored in the 
miscellaneous data field 425 after receiving the image data 65 
from the auto-rotate unit 422. In this alternative 
embodiment, the defective image sensor 304 pixel informa- 



tion must also be rotated by the auto-rotate unit 422 in the 
same manner as for the image data, described below. 

The image capture unit 428 preferably is designed in two 
embodiments, a hardware embodiment and a software 
embodiment; however, the hardware embodiment is pre- 
ferred. 

Hardware Embodiment 

In the hardware embodiment, the image sensor 304 is 
comprised of at least one more extra row and column than 
the image processing unit 424 is designed to process. Thus, 
if the image processing unit 424 is designed to process a 480 
by 640 pixel signal array, then the image sensor 304 must be 
at least a 481 by 641 pixel array (i.e. "i" is 481 and"j" is 641 
in FIG. 3G). The discussion that follows on the auto-rotate 
unit 422 makes clear when and why the additional row and 
column is required. 
Software Embodiment 

The software embodiment is required when the image 
sensor 304 lacks any additional rows and columns beyond 
those that the image processing unit 424 is designed to 
process. For Bayer pattern image processing, the image 
capture unit 428 must generate an additional row and 
column of image data. (For non- Bayer pattern image data, a 
straightforward rotation is performed as is described below 
and an additional row and column is not required.) Thus, for 
example, if the image sensor 304 is comprised of a 480 by 
640 pixel array and the image processing unit 424 is 
designed to process a 480 by 640 array, then the image 
capture unit 428 must generate an additional row and 
column of pixels. In the preferred software embodiment, the 
additional row generated corresponds to row r, (i.e. 
GRGRGR) in FIG. 3C and the additional column generated 
corresponds to column c,- (i.e. GBGBGB) in FIG. 3C. The 
additional row and column may be generated in any number 
of ways, including: setting the additional pixels to black; 
creating a duplicate of a nearby line of pixels with the same 
pixel pattern (i.e. two pixel lines over); generating a dupli- 
cate of the nearest color (i.e. G's would be copied from one 
pixel line over while R's or B's would be copied from two 
pixel lines over); setting the pixel values based on a filtering 
algorithm which looks at a number of nearby pixels; or 
setting the additional row and column of pixels randomly. 

The auto-rotate unit 422 transforms the captured image 
data into the rotated image data for further processing by the 
image processing unit 424. The image processing unit 424 
receives the rotated image data from the auto-rotate unit 422 
and transforms it into processed image data, ready for saving 
in the storage memory 420. The operating system unit 426 
is coupled to the internal bus 402 and preferably comprises 
a conventional set of program instructions for controlling the 
configuration and usage of the computer's 208 hardware 
resources. The operations performed by the auto-rotate unit 
422 and the image processing unit 424 are described in more 
detail below. 

Referring now to FIGS. 5A, 5B and 5C, a graphical 
representation is shown in FIG. 5A illustrating portrait__left 
image data within the frame buffer 416; a graphical repre- 
sentation is shown in FIG. 5B illustrating portrait__right 
image data within the frame buffer 416; and a graphical 
representation is shown in FIG. 5C illustrating landscape 
image data within the frame buffer 416. FIGS. 5A, 5B and 
5C all show the same image data 419 within the frame buffer 
data structure 417 filled with different sets of captured image 
data and graphically positioned in the orientation in which 
the camera 200 was held at the time the captured image data 
was generated. As will be discussed in detail below, the 
shaded areas represent a subset of pixel signals within the 
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image data field 419 that the auto-rotate unit 422 selects to shaded area is therefore comprised of i-1 number of rows 

be sent to the image processing unit 424 as the rotated image and j-1 number of columns. Next, the portrait_left spooling 

data! routine defines the shaded area of c 2 as the top line of the 

The auto-rotate unit 422 preferably comprises program , rotated image data and configures the image processing unit 
instructions stored in the non-volatile memory 406 that are 5 424 to accept a line length of i-1 pixels. The portraitjeft 
executed by the processing unit 404. The auto-rotate unit spooling routine first transfers the pixel signal in the image 
422 controls the flow of data between the frame buffer 416 data field 419 location (r f _„ c 2 ) to the image processing unit 
and the image processing unit 424. First, the auto-rotation 424. Decrementing the row number by one, the portrait Jeft 
unit 422 accesses the RLOS signal 421 data field and UDOS spooling routine next transfers the pixel signal at location 
signal 423 data field from the frame buffer data structure 10 (r w , c 2 ) to the image processing unit 424, and so on until 
417; and, based on this orientation data, selects either a pixel 0*i,c 2 ) has been transferred. The portrait_left spooling 
portrait_left spooling routine, a portrait_right spooling routine then increments the column by one to c 3 and resets 
routine or a landscape spooling routine. The spooling rou- the row to r /M in preparation for spooling the next line of 
tines select-out and feed the captured image data stored in pixel signals (having a length of i-1) to the image processing 
the image data field 419 to the image processing unit 424. 15 unit 424, in the same manner as the first line (having a length 
"Spooling" is here defined as a routine for transferring data of i-1) was spooled. The portrait_left spooling routine 
from one unit or device to a second unit or device. It is continues to increment the column number and spool the 
through these spooling routines that the auto-rotate unit 422 next line of pixel signals (having a length of i-1) to the 
transforms the captured image data into the rotated image image processing unit 424 until column Cj has been spooled, 
data. While the effect of the auto-rotate unit 422 is only 20 The pixel signals within either row r, or column c x are not 
described below with reference to the captured image data, sent to the image processing unit 424 since the image 
some of the additional information stored in the working processing unit 424 is preferably designed to process only an 
memory 418 (such as the location of any defective pixels, i-1 by j-1 array of pixel signals. As a result of this spooling 
rows or columns within the image sensor 304) will also be sequence, the entire set of pixel signals representing a 
rotated, as described above. This additional information is 25 portrait Jeft image has been transferred to the image pro- 
then used by the image processing unit 424. Alternatively, a cessing unit 424. Furthermore, due to this specific spooling 
defective pixel correction algorithm can be applied to the sequence, the portrait left image will be displayed on the 
image data prior to rotation of the image data. Each of the image display 100 so that the* "TOP" -of the portrait_left 
different spooling routines are described in detail below. image corresponds to the top 102 of the image display 100. 

First, the auto-rotate unit 422 determines the image sen- 30 If the portrait__right spooling routine is selected, the 

sor's 304 orientation at the time the image was captured, by auto-rotate unit 422 interprets the captured image data 

accessing the RLOS signal 421 and UDOS signal 423 data . within the image data field 419 as shown in FIG. 5B. FIG. 

fields. Next, if the RLOS signal 421 data field contains a 5B shows an i-row by j-column set of captured image data 

portrait_left signal and the UDOS signal 423 data field in a portrait_right orientation. As shown, the "TOP" of the 

contains a level signal, the auto-rotate unit 422 selects the 35 portrait_right orientation corresponds to column c y-1 . A 

portrait_left spooling routine. However, if the RLOS signal subset of . the image data field 419 is selected by the 

421 data field contains a portrait_right signal and the UDOS portrait__right spooling routine, as shown by the shaded gray 

signal 423 data field contains a level signal, the auto-rotate area in FIG. 5B, to be sent, to the image processing unit 424. 

unit 422 selects the portrait_right spooling routine. Lastly, The shaded area of FIG. 5B is defined from rows r 2 to r,, and 

if the RLOS signal 421 data field contains a landscape signal 40 from columns Cj to Cj_ v The total array size of the shaded 

and the UDOS signal 423 data field contains a level signal, area is therefore comprised of i-1 number of rows and j-1 

or whenever the UDOS signal 423 data field contains an number of columns. Next, the portrait_right spooling rou- 

off-level signal, regardless of what the RLOS signal 421 data tine defines the shaded area of c^, as the top line of the 

field contains, the auto-rotate unit 422 selects the landscape rotated image data and configures the image processing unit 

spooling routine. Each of the three spooling routines within 45 424 for a line length of i-1 pixels. The portrait_right 

the auto-rotate unit 422 are now discussed below. spooling routine first transfers the pixel signal in the image 

If the portrait_left spooling routine is selected, the auto- data field 419 location (r 2 , c,.,) to the image processing unit 

rotate unit 422 interprets the captured image data within the 424. Incrementing the row number by one, the portrait__ 

image data field 419 as shown in FIG. 5A. FIG. 5 A shows right spooling routine next transfers the pixel signal at 

an i-row by j-column set of captured image data in a 50 location (r 3 , c^) to the image processing unit 424, and so 

portrait_left orientation. As shown, the "TOP" of the on until pixel (r,., c^) has been transferred. The portrait^ 

portrait__left orientation corresponds to column c 2 . Note that right spooling routine then decrements the column by one to 

the "row" and "column" designations defined for the image Cj_ 2 and resets the row to r 2 in preparation for spooling the 

sensor 304 in FIG. 3C are retained for clarity in FIGS. 5 A, next line of pixel signals (having a length of i-1) to the 

5B and 5C even though the camera has been rotated into the 55 image processing unit 424, in the same manner as the first 

portrait_left orientation. Conventional image processing line (having a length of i-1) was spooled. The portrait_right 

units are designed to receive image data in a constant pixel spooling routine continues to decrement the column number 

pattern format. Using the Bayer pattern format (assumed for and spool the next line of pixel signals (having a length of 

the purposes of this discussion) the image processing unit i-1) to the image processing unit 424 until column c x has 

424 must receive the image data from the image data field 60 been spooled. Thus, the entire set of pixel signals represent- 

419 starting with a "GRGRGR" line and followed by a ing a portrait_right image has been transferred to the image 

"BGBGBG" line, in an alternating line-by-line pattern. processing unit 424. As a result of this specific spooling 

Therefore, a subset of the image data field 419 is selected by sequence, the portrait__right image will be displayed on the 

the portrait_left spooling routine, as shown by the shaded image display 100 so that the 'TOP" of the portrait__right 

gray area in FIG. 5A, to be sent to the image processing unit 65 image corresponds to the top 102 of the image display 100. 

424. The shaded area of FIG. 5 A. is defined from rows r t to If the landscape spooling routine is selected, the auto- 

r f _ p and from columns c 2 to c y . The total array size of the rotate unit 422 interprets the captured. image data within the 



US RE 

11 

image data field 419 as shown in FIG. 5C. FIG. 5C shows 
an i-row by j-column set of captured image data in a 
landscape orientation. As shown, the 'TOP" of the land- 
scape orientation corresponds to r,. A subset of the image 
data field 419 is selected by the landscape spooling routine, 
as shown by the shaded gray area in FIG. 5C, to be sent to 
the image processing unit 424. The shaded area of FIG. 5C 
is defined from rows r, to r ( _,, and from columns c, to c,_ , . 
The total array size of the shaded area is therefore comprised 
ofi-1 number of rows and j-1 number of columns. Next, the 
landscape spooling routine defines the shaded area of r, as 
the top line of the rotated image data and configures the 
image processing unit 424 for a line length of j- 1 pixels. 
Alternatively, the shaded gray area representing the rotated 
image data could be positioned over diiferent sets of pixel 
signals within the image data field 419, again subject to the 
constraint that the top line begin with the "GRGRGR" 
pattern. The landscape spooling routine first transfers the 
pixel signal in the image data field 419 location (r, , c,) to the 
image processing unit 424. Incrementing the column num- 
ber by one, the landscape spooling routine next transfers the 
pixel signal at location (r,, c 2 ) to the image processing unit 
424, and so on until pixel (r,, c y _,) has been transferred. The 
landscape spooling routine then increments the row by one 
to r 2 and resets the column to c, in preparation for spooling 
the next line of pixel signals (having a length of j-1) to the 
image processing unit 424, in the same manner as the first 
line (having a length of was spooled. The landscape 
spooling routine continues to increment the row number and 
spool the next line of pixel signals (having a length of j-1) 
to the image processing unit 424 until row r,_, has been 
spooled. Thus, the entire set of pixel signals representing a 
landscape image has been transferred to the image process- 
ing unit 424. As a result of this specific spooling sequence, 
the landscape image will be displayed on the image display 
100 so that the "TOP" of the landscape image corresponds 
to the top 102 of the image display 100. 

Also as introduced above, the image processing unit 424 
preferably comprises program instructions stored in the 
non-volatile memory 406 that are executed using the pro- 
cessing unit 404. The image processing unit 424 receives the 
rotated image data from the auto-rotate unit 422, performs 
conventional image processing operations (such as white 
balancing, reconstruction, color correction, gamma 
correction, sharpening and compression) on the rotated 
image data; generates processed image data; and either saves 
the processed image data to the storage memory 420 or 
outputs it to a host computer (not shown) via the I/O 
interface 414. As was discussed above, the image processing 
unit 424 is preferably implemented such that it must receive 
all the image data spooled from the frame buffer 416 starting 
with a "GRGRGR" line followed by a "BGBGBG" line in 
an alternating line-by-line pattern. This is the image pro- 
cessing unit's 424 design limitation which drives the auto- 
rotate unit's 422 particular pixel selection routines described 
above. Alternatively, a different image processing unit 424 
could be implemented which requires that the image data be 
spooled from the frame buffer 416 starting with a "GBG- 
BGB" line followed by a "RGRGRG" line or any combi- 
nation of the Bayer pattern. 

Those skilled in the art will also recognize that alternate 
embodiments of the present invention that do not use the 
Bayer pattern may still use the teachings of present inven- 
tion to rotate their image data. In such alternative embodi- 
ments the auto-rotate unit 422 performs a straightforward 
rotation of the image data since such alternative image 
processing units 424 may accept pixel signals in any orien- 
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tation. Thus for the straightforward rotation where the 
shaded gray area of FIG. 5C represents the image data, the 
portrait_Jeft spooling routine would start with pixel signal 
(r f _,, c,), spool column c,, increment the column to c 2 , spool 

5 column c 2 and so on; the portrait_right spooling routine 
would start with pixel signal (r,, c y _,), spool column Cy_ |f 
decrement the column to c 7 _ 2 , spool column c y _ 2 and so on; 
and the landscape spooling routine would start with pixel 
signal (r,, c,), spool row r,, increment the row to r 2 , spool 

10 row r 2 and so on: In all three cases above, the extra or 
provided row r, and extra or provided column Cj would not 
be transferred. 

Referring now to FIGS. 6A, 6B, 6C and 6D, a flowchart 
of a preferred method for rotating the display orientation of 

15 a captured image is shown. The method begins in FIG. 6A 
with step 600 where the image capture unit 428 captures a 
set of image data and a set of image sensor 304 orientation 
data approximately simultaneously. The RLOS 421 and 
UDOS 423 orientation signals are recorded when the image 

20 data capture occurs in order to insure that the orientation 
sensor information accurately reflects the actual position of 
the image sensor 304. In step 602, the image capture unit 
428 transfers the captured image data and the image sensor 
304 orientation data into the volatile memory 410. In Step 

25 603, the image capture unit 428 generates an additional row 
and column of image data if the captured image data does 
not already include an extra row and column of image data. 
In Step 604, the auto-rotate unit 422 determines the orien- 
tation of the captured image data. If in step 606 the captured 

30 image data is in a portrait_left orientation, the method 
proceeds to step 612, otherwise the method continues to step 
608. If in step 608 the captured image data is in a portraits 
right orientation, the method proceeds to step 628, otherwise 
the method proceeds to step 644. 

35 In step 612 of FUG. 6B, the auto-rotate unit 422 configures 
the image processing unit 424 to accept an image data line 
length corresponding to a portrait_left image. In step 614, 
the auto-rotation unit 422 initializes a variable named "col- 
umn" stored in the working memory 418 to a first pixel 

40 column (i.e. to column c 2 ), within the image data field 419, 
required by the image processing unit 424. In step 616, the 
auto-rotation unit 422 initializes a variable named "row" 
stored in the working memory 418 to a row (i.e. to row r w ) 
within the image data field 419 containing a first pixel color 

45 required by the image processing unit 424. Next, in step 618, 
the auto-rotate unit 422 transfers the captured image data in 
the image data field 419 location (r, T , H ., c f . ofuam ) to the image 
processing unit 424. In step 620, the auto-rotate unit 422 
decrements "row" to a row containing a next pixel color 

50 required by the image processing unit 424. In step 622, if 
"last row" has been transferred, the method proceeds to step 
623, otherwise the method returns to step 618. In the 
preferred embodiment "last row" is "r," as shown in FIG. 
5A. When "last row" has been transferred in step 622, an 

55 entire line of portrait_left image data has been transferred to 
the image processing unit 424. In step 623 the image 
processing unit 424 performs any required image processing 
on the transferred image data. Step 624 then increments 
"column" to a next pixel column required by the image 

60 processing unit 424. Finally, if in step 626 "last column" has 
not yet been transferred the method returns to step 616, 
otherwise the method ends. In the preferred embodiment 
"last column" is "c,," as shown in FIG. 5A. 

In step 628 of FIG. 6C, the auto-rotate unit 422 configures 

65 the image processing unit 424 to accept an image data line 
length corresponding to a portrait_right image. In step 630, 
the auto-rotation unit 422 initializes a variable named "col- 
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umn" stored in the working memory 418 to a first pixel 
column (i.e. to column c^), within the image data field 419, 
required by the image processing unit 424. In step 632, the 
auto-rotation unit 422 initializes a variable named "row" 
stored in the working memory 418 to a row (i.e. to row r 2 ) 5 
within the image data field 419 containing a first pixel color 
required by the image processing unit 424. Next, in step 634, 
the auto-rotate unit 422 transfers the captured image data in 
the image data field 419 location (r, ww , c column ) to the image 
processing unit 424. In step 636, the auto-rotate unit 422 10 
increments "row" to a row containing a next pixel color 
required by the image processing unit 424. In step 638, if 
"last row" has been transferred, the method proceeds to step 
639, otherwise the method returns to step 634. In the 
preferred embodiment "last row" is "r t ," as shown in FIG. 15 
5B. When "last row" has been transferred in step 638, an 
entire line of portrait_right image data has been transferred 
to the image processing unit 424. In step 639 the image 
processing unit 424 performs any required image processing 
on the transferred image data. Step 640 then decrements 20 
"column" to a next pixel column required by the image 
processing unit 424. Finally, if in step 642 "last column" has 
not yet been transferred the method returns to step 632, 
otherwise the method ends. In the preferred embodiment 
"last column" is "c p " as shown in FIG. 5B. 25 

In step 644 of FIG. 6D, the auto-rotate unit 422 configures 
the image processing unit 424 to accept an image data line 
length corresponding to a landscape image. In step 646, the 
auto-rotation unit 422 initializes a variable named "row", 
stored in the working memory 418 to a first pixel row (i.e. 30 
to row r^, within the image data field 419, required by the 
image processing unit 424. In step 648, the auto-rotation unit 
422 initializes a variable named "column" stored in the 
working memory 418 to a column (i.e. to column c x ) within 
the image data field 419 containing a first pixel color 35 
required by the image processing unit 424. Next, in step 650, 
the auto-rotate unit 422 transfers the captured image data in 
the image data field 419 location (r mw , c rolumn ) to the image 
processing unit 424. In step 652, the auto-rotate unit 422 
increments "column" to a column containing a next pixel 40 
color required by the image processing unit 424. In step 654, 
if "last column" has been transferred, the method proceeds 
to step 655, otherwise the method returns to step 650. In the 
preferred embodiment "last column" is "c^," as shown in 
FIG. 5C. When "last column" has been transferred in step 45 
654, an entire line of landscape image data has been trans- 
ferred to the image processing unit 424. In step 655 the 
image processing unit 424 performs any required image 
processing on the transferred image data. Step 656 then 
increments "row" to a next pixel row required by the image 50 
processing unit 424. Finally, if in step 658 "last row" has not 
yet been transferred the method returns to step 648, other- 
wise the method ends. In the preferred embodiment "last 
row" is %_!," as shown in FIG. 5C. 

While the present invention has been described with 55 
reference to certain preferred embodiments, those skilled in 
the art will recognize that various modifications may be 
provided. For instance, while the preferred embodiment of 
the present invention selects and processes the captured 
image data as a rectangular array, alternate embodiments 60 
could select and process the image data as an array of tiles 
rather than lines. Furthermore, by transferring the pixels 
signals to the image processing unit 424 in a different order, 
a mirror image or an upside-down image of the captured 
image data can be presented on the image display 100. 65 
Lastly, while the preferred embodiment is implemented in 
software, those skilled in the art would readily recognize that 



a hardware equivalent implementation would also be accept- 
able. These and other variations upon and modifications to 
the preferred embodiment are provided for by the present 
invention which is limited only by the following claims. 
What is claimed is: 

1. An apparatus for rotating a display orientation of 
captured image data representative of an object, the appa- 
ratus comprising: 

an image sensor, for generating said captured image data; 

an orientation sensor coupled to said image sensor, for 
generating a signal corresponding to the position of the 
image sensor relative to said object; 

a memory, having an auto-rotate unit comprising program 
instructions for selectively transforming said captured 
image data into rotated image data in response to said 
position signal, said memory coupled to said image 
sensor and to said orientation sensor; and 

an image processing unit coupled to said memory for 
executing program instructions stored in said memory; 

[wherein (a) said image processing unit processes an 
i-by-j array of said captured image data and said image 
sensor generates an i+l-by-j+1 array of said image 
data, or (b) an image capture unit generates an addi- 
tional row and column of pixels for said captured image 
data from said image sensor]; and \ 

an image capture unit generates an additional row and 
column of pixels for said captured image data from said 
image sensor. 

2. The apparatus of claim 1, wherein the memory further 
comprises: 

an image processing unit comprising program instructions 
for. transforming one from a group consisting of. cap- 
tured image data and portrait image data, into pro- 
cessed image data. 

3. The apparatus of claim 1, wherein: the signal is a 
portrait_left signal if the image sensor is rotated clockwise 
from a landscape orientation relative to the object, and the 
signal is a portrait__right signal if the image sensor is rotated 
counter-clockwise from the landscape orientation relative to 
the object; and 

the auto-rotate unit comprises program instructions for 
transforming the captured image data into portrait_left 
image data in response to the portrait_Jeft signal and 
into portrait_right image data in response to the 
portrait_right signal. 

4. The apparatus of claim 1, wherein: 

the signal is a landscape signal if the image sensor is 
positioned in a level orientation relative to the object; 
and 

the auto-rotate unit comprises program instructions for 
transforming the captured image data into landscape 
image data in response to the landscape signal. 

5. The apparatus of claim 3, wherein: 

the image sensor has a top, a bottom, a right side and a left 
side; 

the auto-rotate unit program instructions transform the 
captured image data into the portrait_left image data 
by transferring a prior portrait_left line of image data 
which starts further toward the bottom of the image 
sensor and ends further toward the top of the image 
sensor, then transferring a subsequent portrait_left line 
of image data, located closer to the right side of the 
image sensor than the prior portrait_left line of image 
data, and also starting further toward the bottom of the 
image sensor and ending further toward the top of the 
image sensor; and 
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the auto-rotate unit program instructions transform the 
captured image data into the portrait_right image data 
by transferring a prior portrait_right line of image data 
which starts further toward the top of the image sensor 
and ends further toward the bottom of the image sensor, 
then transferring a subsequent portrait_right line of 
image data, located closer to the left side of the image 

sensor than the prior portrait right line of image data, 

and also starting further toward the top of the image 
sensor and ending further toward the bottom of the 
image sensor. 

6. The apparatus of claim 4, wherein: 

the image sensor has a top, a bottom, a right side and a left 
side; and 

the auto-rotate unit program instructions transform the 
captured image data into the landscape image data by 
transferring a prior landscape line of image data which 
starts further toward the left side of the image sensor 
and ends further toward the right side of the image 
sensor, then transferring a subsequent landscape line of 
image data, located closer to the bottom of the image 
sensor than the prior landscape line of image data, and 
also starting further toward the left side of the image 
sensor and ending further toward the right side of the 
image sensor. 

7. The apparatus of claim 3, wherein: 

the portrait_left signal is generated by the orientation 
sensor if the image sensor is rotated approximately 45° 
clockwise from the level orientation, and the portrait_ 
right signal is generated by the orientation sensor if the 
imaging subsystem is rotated approximately 45° 
counter-clockwise from the level orientation. 

8. The apparatus of claim 5, wherein: 

the prior portrait left line of image data and the prior 

portrait_right line of image data comprise a "green, 
red, green, red" pixel pattern; and 

the subsequent portrait_left line of image data and the 
subsequent portrait_right line of image data comprise 
a "blue, green, blue, green" pixel pattern. 

9. An apparatus for rotating a display orientation of 
multicolor captured image data having an i-by-j pixel matrix 
with a pattern representative of an object, comprising: 

an image sensor, for generating the multicolor captured 
image data; 

an input device, for generating a portrait left signal in 

response to a first user selection, a portrait__right signal 
in response to a second user selection, and a landscape 
signal in response to a third user selection; 
a memory, having: 
an auto-rotate unit comprising program instructions for 
selectively transforming the multicolor captured 

image data into portrait left image data in response 

to the portrait Jeft signal, portraiL_right image data 
in response to the protrait_right signal, and land- 
scape image data in response to the landscape signal; 
and 

an image processing unit comprising program instruc- 
tions for transforming the portrait left image data, 

the portrait_right image data and the landscape 
image data into processed image data; and 
a processing unit, coupled to the image sensor, to the input 
device, and to the memory, for executing program 
instructions stored in the memory; 
wherein said image processing unit changes the number 
of pixel rows and pixel columns of the multicolor 



captured image data such that, from a defined refer- 
enced viewpoint, the portrait left image data, the por- 
trait right image data, and the landscape image data, 
each includes the an (i-l)-by-(j-I) pixel matrix having 
said pattern. 

10. The apparatus of claim 9, wherein the image process- 
ing unit has a first line length for processing the portrait_left 
image data and the portrait_right image data and a second 
line length for processing the landscape image data. 

11. A method for rotating a display orientation of image 
data representative of an object, comprising the steps of: 

generating image data with an image sensor; 
identifying an orientation of the image sensor relative to 
the object at a time substantially simultaneous with the 
generating step, where said identifying is performed by 
an orientation sensor; and 
selectively transferring data to an image processing unit in 

response to the identifying step; 
[wherein said image processing unit rotates said display 
orientation of said image data and (a) said image 
processing unit processes an i-by-j array of said cap- 
tured image data and said image sensor generates an 
i+l-by-j+1 array of said image data, or (b) an image 
capture unit generates an additional row and column of 
pixels for said captured image data from said image 
sensor] 

wherein said image processing unit rotates said orienta- 
tion of said image data by generating an additional row 
and column of pixels for said captured image data from 
said image sensor. 
[12. The method of claim 11, further comprising the step 

of: 

generating an additional row and column of image data.] 

13. The method of claim 11, further comprising the step 
of correcting defects within the image data caused by defects 
within the image sensor. 

14. The method of claim 11, wherein the image sensor 
comprises a top, a right side and a left side, wherein the 
mage comprises a "top portion," and wherein the step of 
identifying an orientation further comprises the steps of: 

identifying a portrait_Jeft orientation, if the left side of 
the image sensor corresponds to the "top portion" of the 
object; 

identifying a portrait_right orientation, if the right side of 
the image sensor corresponds to the "top portion" of the 
object; and 

identifying a landscape orientation, if the top of the image 
sensor corresponds to the "top portion" of the object. 

15. The method of claim 11, wherein the step of identi- 
fying an orientation further comprises the steps of: 

identifying a portrait__left orientation, in response to a 
user selection of the portrait_left orientation on an 
input device; 

identifying a portrait_right orientation, in response to a 
user selection of the protrait_right orientation on the 
input device; and 
identifying a landscape orientation, in response to a user 
selection of the landscape orientation on the input 
device. 

16. The method of claim 11, wherein the orientation is a 
portrait__left orientation, wherein the image data is com- 
prised of an array of pixel colors ordered in rows and 
columns, and wherein the step of selectively transferring 

65 comprises the steps of: 

initializing a column variable to a first column of pixel 
colors required by the image processing unit; 
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initializing a row variable to a row containing a first pixel 

color required by the image processing unit; 
transferring pixel color at an array location defined by the 

row variable and the column variable to and the image 

processing unit; 
decrementing the row variable to a row containing a next 

pixel color required by the image processing unit; 
returning to the transferring step, if a row containing a last 

pixel color has not been transferred; 
incrementing the column variable to a next column of 

pixel colors required by the image processing unit; and 
returning to the initializing a row variable step, if a last 

column of pixel colors has not been transferred. 

17. The method of claim 16, wherein the image data is 
replaced by defective image sensor information, further 
comprising the step of repeating the steps of claim 16. 

18. The method of claim 16, further comprises the steps 

of: 

configuring the image processing unit to accept an image 20 
data line length corresponding to the portrait_left 
orientation; and 

performing image processing on a line of transferred 
image data. 

19. The method of claim 11, wherein the orientation is a 25 
portrait_right orientation, wherein the image data is com- 
prised of an array of pixel colors ordered in rows and 
columns, and wherein the step of selectively transferring 
comprises the steps of: 

initializing a column variable to a first column of pixel 30 

colors required by the image processing unit; 
initializing a row variable to a row containing a first pixel 

color required by the image processing unit; 
transferring pixel color at an array location defined by the 

row variable and the column variable, to the image 

processing unit; 
incrementing the row variable to a row containing a next 

pixel color required by the image processing unit; 
returning to the transferring step, if a row containing a last 40 

pixel color has not been transferred; 
decrementing the column variable to a next column of 

pixel colors required by the image processing unit; and 
returning to the initializing a row variable step, if a last 

column of pixel colors has not been transferred. 

20. The method of claim 11, wherein the orientation is a 
landscape orientation, wherein the image data is comprised 
of an array of pixel colors ordered in rows and columns, and 
wherein the step of selectively transferrin g further comprises 
the steps of: — ^ 
, initializing a row variable to a first row of pixel colors 

required by the image processing unit; 
initializing a column variable to a column containing a 

first pixel color required by the image processing unit; 
transferring pixel color at an array location defined by the 

row variable and the column variable, to the image 

processing unit; 
incrementing the column variable to a column containing 

a next pixel color required by the image processing 

unit; 

returning to the transferring step, if a column containing 
a last color pixel has not been transferred; 

incrementing the row variable to a next row of pixel 
colors required by the image processing unit; and 

returning to the initializing a column variable step, if a last 
row of pixel colors has not been transferred. 
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21. An apparatus for rotating a display orientation of 
multicolor image data having an i-by-j pixel matrix with a 
pattern representative of an object, comprising: 

means for generating multicolor image data with an image 
sensor, the image data having a Bayer pattern; 

orientation sensor means for identifying an orientation of 
said image sensor relative to said object at a time 
substantially simultaneous with said generating said 
multicolor image data; and 

means for selectively transferring said multicolor image 
data to an image processing unit in response to said 
means for identifying; 

wherein said image processing unit rotates said display 
orientation of said multicolor image data for providing 
rotated multicolor image data, and changes the number 
of pixel rows and pixel columns of said multicolor 
image data such that, from a defined referenced 
viewpoint, said rotated multicolor image data includes 
an (i-l)-by-(j-l) pixel matrix having said pattern. 

22. The apparatus of claim 21, further comprising means 
for generating an additional row and column of image data. 

23. The apparatus of claim 21, further comprising means 
for correcting defects within the image data caused by 
defects within the image sensor. 

24. The apparatus of claim 21, wherein the image sensor 
comprises a top, a right side and a left side, wherein the 
image comprises a "top portion," and wherein the means for 
identifying an orientation further comprises: 

means for identifying a portrait__left orientation, if the left 

side of the image sensor corresponds to the "top 

portion" of the object; 
means for identifying a portrait__right orientation, if the 

right side of the image sensor corresponds to the "to 

^portion" of the object; and 
means for identifying a landscape orientation, if the top of 

the image sensor corresponds to the "top portion" of the 

object. 

25. The apparatus of claim 21, wherein the orientation is 
a portrait_jeft orientation, wherein the image data is com- 
prised of an array of pixel colors ordered in rows and 
columns, and wherein the means for selectively transferring 
comprises: 

means for initializing a column variable to a first column 
of pixel colors required by the image processing unit; 

means for initializing a row variable to a row containing 
a first pixel color required by the image processing unit; 

means for transferring pixel color at an array location, 
defined by the row variable and the column variable, to 
the image processing unit; 

means for decrementing the row variable to a row con- 
taining a next pixel color required by the image pro- 
cessing unit; 

means for returning to the means for transferring, if a row 
containing a last pixel color has not been transferred; 

means for incrementing the column variable to a next 
column of pixel colors required by the image process- . 
ing unit; and 

means for returning the means for initializing a row 
variable, if a last column of pixel colors has not been 
transferred. 

26. The apparatus of claim 21, wherein the orientation is 
a portrait_right orientation, wherein the image data is 
comprised of an array of pixel colors ordered in rows and 
columns, and wherein the means for selectively transferring 
comprises: 

means for initializing a column variable to a first column 
of pixel colors required by the image processing unit; 
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means for initializing a row variable to a row containing 
a first pixel color required by the image processing unit; 

means for transferring pixel color at an array location, 
defined by the row variable and the column variable, to 
the image processing unit; 

means for incrementing the row variable to a row con- 
taining a next pixel color required by the image pro- 
cessing unit; 

means for returning to the means for transferring, if a row 
containing a last pixel color has not been transferred; 

means for decrementing the column variable to a next 
column of pixel colors required by the image process- 
ing unit; and 

means for returning to the means for initializing a row 
variable, if a last column of pixel colors has not been 
transferred. 

27. The apparatus of claim 21, wherein the orientation is 
a landscape orientation, wherein the image data is comprised 
of an array of pixel colors ordered in rows and columns, and 
wherein the means for selectively transferring comprises: 

means for initializing a row variable to a first row of pixel 

colors required by the image processing unit; 
means for initializing a column variable to a column 

containing a first pixel color required by the image 

processing unit; 
means for transferring pixel color at an array location, 

defined by the row variable and the column variable, to 

the image processing unit; 
means for incrementing the column variable to a column 30 

containing a next pixel color required by the image 

processing unit; 
means for returning to the means for transferring, if a 

column containing a last color pixel has not been 

transferred; 

means for incrementing the row variable to a next row of 
pixel colors required by the image processing unit; and 

means for returning to the means for initializing a column 
variable, if a last row of pixel colors has not been 
transferred. 

28. A computer useable medium embodying computer 
readable program code for causing a computer to rotate a 
display orientation of multicolor image data having an i-by-j 
pixel matrix with a pattern representative of an object, by 
performing steps comprising: 

generating said multicolor image data with an image 

sensor, the image data having a Bayer pattern; 
identifying an orientation of the image sensor relative to 
the object at a time substantially simultaneous with the 
generating step, wherein said identifying of said orien- 50 
tation is performed with an orientation sensor; and 
selectively transferring image data to an image processing 

unit in response to the identifying step, 
wherein said image processing unit rotates said display 
orientation of said multicolor image data for providing 55 
rotated multicolor image data, and changes the number 
of pixel rows and pixel columns of said multicolor 
image data such that, from a defined referenced 
viewpoint, said rotated multicolor image data includes 
having a n (i-l)-by-(j-l) pixel matrix having said pat- 
Tern. 

29. The computer useable medium of claim 28, further 
comprising program code for generating an additional row 
and column of image data. 

30. The computer useable medium of claim 28, further 65 
comprising program code for correcting defects within the 
image data caused by defects within the image sensor. 
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31. The computer useable medium of claim 28, wherein 
the image sensor comprises a top, a right side and a left side, 
wherein the image comprises a "top portion," and wherein 
the program code for performing the step of identifying an 
orientation further comprises program code for: 

identifying a portrait_left orientation, if the left side of 
the image sensor corresponds to the "top portion" of the 
object; 

identifying a portraiLjright orientation, if the right side of 
the image sensor corresponds to the "top portion" of the 
object; and 

identifying a landscape orientation, if the top of the image 
sensor corresponds to the "top portion" of the object. 

32. The computer useable medium of claim 28, wherein 
the orientation is a portrait_Jeft orientation, wherein the 
image data is comprised of an array of pixel colors ordered 
in rows and columns, and wherein the program code for 
performing the step of selectively transferring comprises 
program code for: 

initializing a column variable to a first column of pixel 

colors required by the image processing unit; 
initializing a row variable to a row containing a first pixel 

color required by the image processing unit; 
transferring pixel color at an array location, defined by the 

row variable and the column variable, to the image 

processing unit; 
decrementing the row variable to a row containing a next 

pixel color required by the image processing unit; 
returning to the transferring step, if a row containing a last 

pixel color has not been transferred; 
incrementing the column variable to a next column of 

pixel colors required by the image processing unit; and 
returning to the initializing a row variable step, if a last 

column of pixel colors has not been transferred. 

33. The computer useable medium of claim 28, wherein 
the orientation is a protrait_right orientation, wherein the 
image data is comprised of an array of pixel colors ordered 
in rows and columns, and wherein the program code for 
performing the step of selectively transferring comprises 
program code for: 

initializing a column variable to a first column of pixel 

colors required by the image processing unit; 
initializing a row variable to a row containing a first pixel 

color required by the image processing unit; 
transferring pixel color at an array location, defined by the 

row variable and the column variable, to the image 

processing unit; 
incrementing the row variable to a row containing a next 

pixel color required by the image processing unit; 
returning to the transferring step, if a row containing a last 

pixel color has not been transferred; 
decrementing the column variable to a next column of 

pixel colors required by the image processing unit; and 
returning to the initializing a row variable step, if a last 

column of pixel colors has not been transferred. 

34. The computer useable medium of claim 28, wherein 
the orientation is a landscape orientation, wherein the image 
data is comprised of an array of pixel colors ordered in rows 
and columns, and wherein the program code for performing 
the step of selectively transferring comprises program code 
for: 

initializing a row variable to a first row of pixel colors 

required by the image processing unit; 
initializing a column variable to a column containing a 

first pixel color required by the image processing unit; 
transferring pixel color at an array location, defined by the 

row variable and the column variable, to the image 

processing unit; 
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incrementing the column variable to a column containing 
a , next pixel color required by the image processing 
unit; 

returning to the transferring step, if a column containing 
a last color pixel has not been transferred; 

incrementing the row variable to a next row of pixel 
colors required by the image processing unit; and 

returning to the initializing a column variable step, if a last 
row of pixel colors has not been transferred. 

35. An apparatus for rotating a display orientation of 
multicolor captured image data having an i-by-j pixel matrix 
with a pattern representative of an object, comprising: 

an image sensor, for generating said multicolor captured 
image data, the image data having a Bayer pattern; 

an orientation sensor coupled to said image sensor, for 
generating a signal corresponding to the position of 
said image sensor relative to said object; and 

a hardware device, having an auto-rotate unit comprising 
circuits for selectively transforming said multicolor 
captured image data into rotated multicolor image data 
in response to said position signal, said hardware 
device coupled to said image sensor and to said orien- 
tation sensor; 

wherein, from a defined referenced viewpoint, said 
rotated multicolor image data includes an (i-l)-by-(j- 
1) pixel matrix having said pattern. 

36. An apparatus for rotating a display orientation of 
captured image data representative of an object, the appa- 
ratus comprising: 

an image sensor, for generating said captured image 
data; 

an input device, for generating an orientation signal in 

response to a user selection; 
a memory, having an auto- rotate unit for selectively 

transforming said captured image data into rotated 

image data in response to said orientation signal from 

said input device; and 
an image processing unit coupled to said memory for 

processing the image data by generating at least one 

additional row and column of pixels for said captured 

image data from said image sensor. 

37. A digital image capture device, comprising: 
an image sensor, for capturing image data; 

an orientation sensor, for generating an orientation signal 
indicating whether the image sensor is in a portrait or 
landscape position; and 

an auto-rotate unit coupled to the image sensor and the 
orientation sensor, for automatically rotating a subset 
of the image data in response to the orientation signal. 

38. The digital image capture device of claim 37, further 
comprising: 

an image capture unit coupled to the image sensor, for 
adding m additional rows and n additional columns to 
an i-by-j array of image data to form an i+m-by-j+n 
array of image data to be rotated by the auto-rotate unit 
in response to the orientation signal. 

39. A method of rotating image data in a digital image 
capture device, comprising: 

capturing image data from an image sensor; 
providing an orientation signal indicating whether the 
image sensor is in a portrait or landscape position; and 
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automatically rotating a subset of the captured image 
data in response to the orientation signal. 

40. The method of claim 39, further comprising: 
adding m additional rows and n additional columns to an 

i-by-j array of the image data to form an i+m-by-j+n 
array of image data. 

41. A computer-readable medium having stored thereon 
instructions which, when executed by a processor, cause the 
processor to perform the steps of: 

capturing image, data from an image sensor; 
providing an orientation signal indicating whether the 
image sensor is in a portrait or landscape orientation; 
and 

■ automatically rotating a subset of the captured image 
data in response to the orientation signal. 

42. The computer- readable medium of claim 41, further 
comprising: 

adding m additional rows and n additional columns to an 
i-by-j array of the image data to form an i+m-by-j+n 
array of image data. 

43. A digital image capture device, comprising: 
image sensor means for generating image data; 

25 • means for generating an orientation signal indicating 
either a portrait orientation or a landscape orientation 
of the image sensor; and 
means for automatically rotating a subset of the image 
data in response to the orientation signal. 

44. A digital image capture device, comprising: 
an image sensor, for generating said captured image data 

including a plurality of rows and columns of pixels; 
an orientation sensor coupled to said image sensor, for 
generating a position signal indicating whether the 
image sensor is in a portrait or landscape position; 
a memory, having an auto-rotate unit comprising pro- 
gram instructions for selectively transforming said 
captured image data into rotated image data in 
40 response to said position signal by processing at least 
one row of pixels and at least one column of pixels less 
than the plurality of rows and columns of pixels in the 
captured image data, said memory coupled to said 
image sensor and to said orientation sensor; and 
45 an image processing unit coupled to said memory for 
executing the stored program instructions to rotate said 
capture image data. 

45. A method for rotating a display orientation of image 
data, comprising: 

50 generating image data with an image sensor including a 
plurality of rows and columns of pixels; 
determining with an orientation sensor a portrait orien- 
tation or a landscape orientation for the image data 
substantially simultaneously with generating the image 
data; and 

processing the image data with an image processing unit 
in response to the orientation signal to rotate the image 
data, by rotating less than all of the plurality of rows 
and columns, of pixels of the image data. 
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